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Quantum Operation Time Reversal 
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The dynamics of an open quantum system can be described by a quantum operation, a linear, 
complete positive map of operators. Here, I exhibit a compact expression for the time reversal of a 
quantum operation, which is closely analogous to the time reversal of a classical Markov transition 
matrix. Since open quantum dynamics are stochastic, and not, in general, deterministic, the time 
reversal is not, in general, an inversion of the dynamics. Rather, the system relaxes towards equilib- 
rium in both the forward and reverse time directions. The probability of a quantum trajectory and 
the conjugate, time reversed trajectory are related by the heat exchanged with the environment. 

PACS numbers: 05.30.Ch, 05.70.Ln 



Introduction 

Consider a sequence of states sampled from a classi- 
cal, homogeneous, steady-state, Markov chain [H, For 
example, 

A, B, C, A, A, B, C, A, B, C, A 

where the three states are labeled {A,B,C) and time is 
read from left to right. The reversed sequence of states, 
reading from right to left, is also Markovian, homoge- 
neous in time and has the same equilibrium probability 
distribution. Moreover, the probability of the transition 
i ^ j in the forward chain will be the same as the proba- 
bility of the opposite transition j —>■ iin the time reversed 
chain. Classical Markov dynamics are equipped with a 
natural time-reversal operation. 

The quantum mechanical generalization of a Markov 
transition matrix is a quantum operation, a linear, 
tracepreserving, complete positive (TCP) map of opera- 
tors [ElljSIll- These superoperators can describe a wide 
range of dynamics, including the pure quantum dynam- 
ics of an isolated system, the mixed quantum-classical 
dynamics of a system interacting with the environment, 
and the disturbance induced by measurements of the sys- 
tem, either projection into a subspace due to a von Neu- 
mann measurement, or a more general positive operator 
valued measurement (POVM) Q. 

In this note, we consider the generalization of classical 
Markov chain time reversal to quantum operations. In 
a quantum system, we cannot meaningfully consider the 
chain of states. Instead, we consider the time-reversal of 
the chain of interactions between the system and environ- 
ment. The time-reversal invariance of an isolated system 
is broken by coupling the system to the environment, and 
the magnitude of this symmetry breaking is related to the 
environmental entropy change. This naturally leads to an 
exposition of the work fluctuation theorem for dissipative 
quantum dynamics. 



Background: Markov chain time reversal 

Let M be the classical Markov transition matrix of a 
forward chain of states (i.e. Mji is the probability of mov- 
ing from state i to state j), M the transition matrix of 
the reversed chain and p° the equilibrium probability dis- 
tribution of both chains (i.e. Mp° = Mp° = p°). Since 
the probability of the transition i — > j in the forward 
chain will be the same as the probability of the opposite 
transition j — > « in the time reversed chain, it follows 
that the forward and reversed chain transition matrices 
are related by 



for all 



(1) 



Note that in much of the Markov chain literature (e.g. 0) 
the transition matrix is the transpose of the matrix de- 
fined here. Also, we have avoided the conventional no- 
tation for the time reversed matrix M since this may 
cause unfortunate confusion in the context of quantum 
dynamics. 

In matrix notation this time reversal operation can be 
conveniently expressed as 



M = diag(p°)M^ diag(p°)- 



(2) 



Here, diag(p°) indicates a matrix whose diagonal ele- 
ments are given by the vector p°. M is referred to as 
the reversal of M , or as the dual of M [l| . A transi- 
tion matrix M is balanced with respect to a probability 
distribution p° if AIp° = p° , and detailed balanced if the 
matrix is time- reversal invariant, M = M . 



Background: Quantum operations 

The dynamics of an open quantum system can be rep- 
resented as the closed system unitary dynamics of the 
system coupled to an extended environment, followed by 
a measurement of the environment. 
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Here p and p' are the initial and final density matrices 
of the system, p-^ is the initial density matrix of the en- 
vironment, J/gjj, is the unitary operator representing the 
time evolution of the combined system over some time 
interval, and trj^, is a partial trace over the environment 
Hilbert space. The superoperator 5 is a quantum opera- 
tion, a linear, trace preserving, complete positive (TCP) 
map of operators [3, 4, 5, 6]. 

Any complete map of positive operators has an 
operator-sum (or Kraus) representation, 

p' = Sp = Y,A^pAi (4) 

Conversely, any operator-sum represents a complete, pos- 
itive superoperator. The collection {Aa} are known as 
Kraus operators. 

The requirement that the quantum operation con- 
served the density matrix trace can be compactly written 
as 

S^I = Y,AiA^^I . (5) 

Here, is the superoperator adjoint of 5, the unique su- 
peroperator such that {SA, B) = {A, B), where {A, B) 
is the Hilbert-Schmit inner product irA'^B. In the op- 
erator sum representation the superoperator adjoint is 
performed by taking the adjoints of the corresponding 
Kraus operators @. 

5p = ^A„pAt, S^p = Y,AipA^ (6) 

a a 

Each Kraus operator of a TCP map represents a par- 
ticular interaction with the environment that an external 
observer could, in principle, measure and record without 
further disturbing the dynamics of the system. The prob- 
ability of observing the ath Kraus interaction is 

Pc^^irAapAi (7) 

and the state of the system after this interaction is 

^1 _ AapA]^ 
tr AapAa 

The overall effect of the dynamics, averaging over differ- 
ent interactions, is the full quantum operation, Eq. (jl]). 

In the limit of small time interval we obtain a contin- 
uous time quantum Markovian dynamic, 

p{t) - exp (^^ C{T)dT^ p{s) (9) 

where C is the Lindbladian superoperator 

Quantum operation time reversal 

We will now consider the time reversal of a quantum 
operation. Since we cannot observe a sequence of states 



for the quantum dynamics (at least, not without measur- 
ing, and therefore disturbing the system) we instead focus 
on the sequence of transitions. Each operator of a Kraus 
operator-sum represents a particular interaction with the 
environment that an external observer could, in principle, 
measure and record. We can therefore define the dynam- 
ical history by the observed sequence of Kraus operators. 
For each Kraus operator of the forward dynamics, Aa, 
there should be a corresponding operator, A^ of the re- 
versed dynamics such that, starting from equilibrium, the 
probability of observing any sequence of Kraus operators 
in the forward dynamics is the same as the probability of 
observing the reversed sequence of reversed operators in 
the reversed dynamics. Specifically, for consecutive pairs 
of events, starting from tt (the invariant, equilibrium den- 
sity matrix of the dynamics Sit — tt) 

p(ai,a2|7r) =p(a2,ai|7r) 

or equivalently [by Eq. ([T])] 

tr (^Aa2Aa-^TrAa_^AaJj = tr ^^cj^q^ttAJj^^J,^^ 

Since the invariant density matrix tt, is positive definite 
it has a unique inverse and a positive definite square root. 
We may therefore insert the identity / — 7r~2 7r2 between 
pairs of Kraus operators. By taking advantage of the 
cyclic property of the trace we find that 

tr (^[tt^ Al^TT-i][Tr^ Al^TT-i]Tr [n-i Aa2TT-i][Tr^ Aa.TT^'j 

^ tr (^Aaj^Aa2 AI^^AI^_^^ . 

Therefore, Aa — vt^AJ^tt^^ and the superoperator 5, the 
reversal or 7r-dual of S, is 

5p = ^ I„ pll = J2[7r-iAi7Th] p [n^AaTT-^] (10) 

a a 

1 1 

If we write "Dt^p for the superoperator n^pir^ then this 
reversal may be expressed independently of any particu- 
lar decomposition of S into Kraus operators. 

S = V^S''V-^] (11) 

By similar reasoning, the time reversal of the Lindbla- 
dian continuous time dynamics [Eq. ^] takes the same 
form, C = Ptt'C^Pj^^, analogous to the time reversal of 
a continuous time Markov chain 0| 

We can readily confirm that the quantum operator re- 
versal [Eq. pTjl ] is an involution (a duality) on TCP maps 
with fixed point tt. From Eq. [TO] it is clear that the re- 
versed superoperator has an operator-sum representation 
and is, therefore, a complete, positive map. Note that 
2?7r = is a Hermitian superoperator (Since positive 
operators are Hermitian tt^ — tt), that I?^/ = tt, and 
that T>~^7T — I. Therefore, the reversal is idempotent, 

S = S, has the correct invariant density matrix, 
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and is trace preserving. 

S'^I = V-^ SV^I = V-^STr^V- 



I. 



If TZ and S are two TCP maps with the same fixed point 
then nS = Sn. 

By analog with classical Markov chain terminology, we 
may say that a quantum operation is balanced with re- 
spect to a density matrix, tt, if iStt — tt, and detailed 
balanced if iS = iS. Conversely, if S is detailed balanced 
with respect to some density matrix tt, then tt is a fixed 
point of S: 

Stt = Stt = V^S^'V-^Ti = V^S""! = V^I = it 

In passing, it is interesting to note that the time rever- 
sal operation, S = 1)^^ S^T)^^ is an anti-linear operator 
of a superoperator, an anti-supcr-duper operator. 



Isolated quantum system 

The operator sum representation of a closed system 
dynamic contains a single, unitary Kraus operator, U — 
e~'s^*, where H is the system Hamiltonian. Any density 
matrix that is diagonal in the energy eigenbasis will be 
a fixed point of this dynamics, and any such diagonal 
operator will commute with the unitary Kraus operator. 
Therefore, the quantum operator reversal corresponds to 
the time- reversal of the unitary dynamics. 

S{t)p = UpU'' = e-i"' p e+T^Ht (13) 
S{t)p = U^pU = e+i"' p e^-fe^* 

Classical Markov chain 

Given an orthonormal basis set {|ei)} we can extract 
the "matrix elements" of a superoperator S. 



Sabcd = {ea\S{\ed){ec\)\eb) 



(13) 



There are several different conventions for the ordering 
of the indices. Caves Q would write Sad,bc and Terhal 
and DiVincenzo Sab,dc- The ordering used here is 
convenient when transitioning to a tensor {S°'^j) or dia- 
grammatic (j^iS^c) notation. 

In any basis the matrix Mac — Saacc is a Markov 
stochastic transition matrix; The elements are real and 
positive Mac > and the rows sum to 1. (Since |ec}(ec| 
is a positive operator and 5 is a positive map, iS(|ec}(ec|) 
must also be a positive operator, and therefore the ele- 
ments are real and positive. The trace preserving con- 
dition requires that S'' I = I. Since / = X^a l^a)(^<i|, 
therefore Y,a ^aacd = Scd and J2a ^'^ac = !■) 

In the diagonal basis of the equilibrium density matrix, 
a time-reversal of the quantum operation induces a time 
reversal of the embedded Markov transition matrix with 



respect to the probability vector on the density matrix 
diagonal. 



Sa 



{ea\n--S'''- TT ^\ec){ec\TT ^ TT^\ea) 



^(e,|5^(|e,)(e,|)|ea) 

^ccaa — _ -^^J^ca 
T^cc Pc 



Thermostated quantum system 

The reduced dynamics of a quantum system interact- 
ing with an external environment or bath can be de- 
rived by considering the deterministic dynamics of the 
joint system, and then tracing over the bath degrees of 
freedom, leaving a quantum operation description of the 
system dynamics alone. In particular, this approach pro- 
vides a concise description of a quantum system interact- 
ing with a thermal environment of constant temperature. 
Let the total Hamiltonian of the combined system be 



eH" 



(14) 



where and are system and bath identity operators, 
is the Hamiltonian of the system, is the bath 
Hamiltonian, i?'"* is the bath-system interaction Hamil- 
tonian and e is a coupling constant. 

We assume that initially the system and bath are un- 
correlated, and therefore the initial combined state is 
p © TT , where 77^ is the thermal equilibrium density 
matrix of the bath. 



Here {Ef} are the energy eigenvalues, are the or- 

thonormal energy eigenvectors of the bath, and is the 
bath partition function. We follow the dynamics of the 
combined system for some time, then measure the state 
of the bath. 



\h){b. 



(15) 



Here, ti^ is a partial trace over the bath degrees of free- 
dom, [/gg — exp(— zi? t/h) is the unitary dynamic of 
the total system, and we have assumed that the coupling 
constant e is small. It follows that the Kraus operators 
for this dynamics are 



(16) 



4 



and the corresponding reversed operators are 



chain 



1 it -i 



(17) 



1 ,e 2 



{h\Ul\h,)]n-'^ 



{h\Ul[I,®n+Hb,) 
-^{b,\Ul\h)- 



If we compare the reversed operator with the correspond- 
ing forward operator we can see that taking the time re- 
versal of a quantum operation that acts on the system 
subspace is equivalent (in the small coupling limit) to 
taking the time reversal of the entire system-bath dy- 
namics. 



Driven quantum dynamics 

Consider a system with a time-dependent Hamiltonian, 
interacting with an external, constant temperature heat 
bath. We split time into a series of intervals, labeled 
by the integer t. The system Hamiltonian changes from 
one interval to the next, but is fixed within each interval. 
(We can recover a continuously varying system Hamilto- 
nian by making the intervals short.) The dynamics are 
described by dissipative quantum operations [Eq. [TS] , St 

with Kraus operators [Eq. ([TB)) ] {A^^}. The dynami- 
cal history of the system is defined by the initial system 
state |eo)(eo|, a sequence of interactions between the sys- 
tem and environment, described by the Kraus operators 

A^a} T A^al T ■ ■ ■ ,A^a} and the final system state \eT-){eT\- 
The probability of observing this history is related to the 
probability of the reversed history in the time reversed 



p(eo;Qo,ai,--- ,Q!r;er) 
p(eT-; ttr, • • • ,011, Ur] eo) 



= exp{-/3Q} 



(18) 



since for every Kraus interaction of the forward dynam- 
ics there is a corresponding interaction in the reverse dy- 
namics such that A]^ = Aa exp{+^(3Qa} [Eq. ([T7])] where 
Q — ^{Ef — Ef) is the heat, the flow of energy from the 
bath to the system during the forward time step. 

p{eo; ai, a2, • • • , ar; e^) 

= tr(e.|4:^ • • • ^i'MiV |eo)(eo|AWt4^)t . . . AMt|e.) 
= tr(eo|AW . . . <)|e.)(e.|I(:)t • ■ • ^Wt|e„) 

X exp {-/3(Qqi +Qa2-\ ^ Qa J} 

= p{er;ar, • • • , ai, a,-; eo) exp {-/SQ} 

Recall that Q is the heat flow into the system, (3 is 
the inverse temperature of the environment, and there- 
fore — /3Q is the change in entropy of that environment. 
This property of microscopic reversibility as expressed in 
Eq. (fT8|) jll, immediately implies that the work fluctu- 
ation relation Q and Jarzynski identity [l3| can be ap- 
plied to a driven quantum system coupled to a thermal 
environment [HI, [H, [l^, H, ■ The crucial difference 
between the classical and quantum regimes is that in the 
quantum case we must avoid explicitly measuring the 
work directly, which is tantamount to continuously mon- 
itoring the system, and instead measure the heat flow 
from the environment [isl . ITsI l . 
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